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METHOD AND APPARATUS FOR 
QUANTIZING A SIGNAL IN A DIGITAL 
SYSTEM 

CROSS REFERENCE TO RELATED 
APPLICATIONS 

This application is related to U.S. application Ser. No, 
08/822,403 filed Mar. 20, 1997, by Yolanda Prieto, entitled 
"Adaptive Filtering For Use With Data Compression and 
Signal Reconstruction," and U.S. application Ser, No. 
08/822,404 filed Mar. 20, 1997, by Yolanda Prieto, entitled 
"Data Compression System, Method, and Apparatus," pre- 
viously filed and assigned to Motorola, Inc. 

TECHNICAL FIELD 

This invention relates in general to data compression and 
particularly to digital data compression. Specifically, the 
invention relates to a method and apparatus that provides 
improved quantization in systems utilizing a trellis coded 
quantizer. 

BACKGROUND 

With the advent of technologies and services related to 
teleconferencing and digital image storage, considerable 
progress has been made in the field of digital signal pro- 
cessing. As will be appreciated by those skilled in the art, 
digital signal processing typically relates to systems, 
devices, and methodologies for generating a sampled data 
signal, compressing the signal for storage and/or 
transmission, and thereafter reconstructing the original data 
from the compressed signal. Critical to any highly efficient, 
cost effective digital signal processing system is the meth- 
odology used for achieving compression. 

As is known in the art, data compression refers to the steps 
performed to map an original data signal into a bit stream 
suitable for communication over a channel or storage in a 
suitable medium. Methodologies capable of minimizing the 
amount of information necessary to represent and recover an 
original data are desirable in order to lower computational 
complexity and cost. In addition to cost, simplicity of 
hardware and software implementations capable of provid- 
ing high quality data reproduction with minimal delay are 
likewise desirable. 

Quantization refers to the technique of taking a bit stream 
of data and compressing it for later reproduction. There are 
several algorithms that may be used to achieve compression 
of a data signal. The most elementary methods take signal 
samples and quantize each signal sample into one of a small 
number of levels. A well-known quantizer is the Lloyd-Max 
optimal quantizer using nearest neighbor, minimum squared 
error (MSE) rules to classify an input into a specified 
number of levels. 

Quantization can be achieved through a variety of other 
approaches including vector, scalar, rounding, truncation, 
and trellis coded quantization (TCQ) among other methods. 
Vector quantization is considered an efficient means of 
quantization, because it takes a group of samples and 
represents that group by only one symbol thus yielding 
improved compression and generating a high signal-to-noise 
(SNR). However, vector quantization is computationally 
intensive and requires a look-up table (i.e. needs memory). 
Scalar quantization represents one sample per symbol and is 
less computationally extensive than vector quantization. 
However, scalar quantization has the disadvantage of lower 
compression rate. An alternative to quantization is the 



8,346 

2 

rounding off or truncating of the output signal but this may 
lead to resolution problems. 

To present, the next standard of JPEG 2000 (Joint Pho- 
tographic Experts Group) systems for still images proposes 
5 algorithms which use a wavelet to achieve decomposition of 
an input signal and a trellis coded quantizer for signal 
compression. 

Trellis coded quantization is based on a Viterbi algorithm 
which provides a search to generate a minimum error path. 

10 Generally, the Viterbi works in conjunction with a lattice 
quantizer (uniform grid). While the lattice quantization 
operation is computationally effective, the result is not 
optimal for distortion. At high compression rates (low bits/ 
sample) the SNR degrades. Hence, there remains a need for 

15 an improved TCQ technique and apparatus that operates to 
reduce the noise generated during data signal compression 
(quantization noise), and improve the achievable signal to 
noise ratio (quality) during data reconstruction. 

lQ Accordingly, there is a need for an improved trellis coded 
quantization (TCQ) technique particularly as applied to 
digital signal processing systems. 

BRIEF DESCRIPTION OF THE DRAWINGS 

25 FIG. 1 is a block diagram of a data CODEC in accordance 
with the preferred embodiment of the invention. 

FIG. 2 is an adaptive centroid based quantizer in accor- 
dance with the present invention. 
3Q FIG. 3 a graphical representation of an example of the 
level distribution for each of the four quantizer states going 
through the first iteration of i-0 for the quantizer of FIG. 2 
in accordance with the present invention. 

FIG. 4 is an example of a pictorial representation of stored 
35 indexes from the first iteration for the quantizer of FIG. 2 in 
accordance with the present invention. 

FIG. 5 a graphical representation of an example of the 
level distribution for each of the four quantizer states going 
through an arbitrary iteration of the quantizer of FIG. 2 in 
40 accordance with the present invention. * 

FIG. 6 is a proposed implementation of a one dimensional 
data stream conversion prior to quantization in accordance 
with an alternative embodiment of the invention. 
FIG. 7 shows the 1-D data stream conversion step as part 
45 of a complete data CODEC system in accordance with the 
alternative embodiment of the invention. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 

50 

White the specification concludes with claims defining the 
features of the invention that are regarded as novel, it is 
believed that the invention will be better understood from a 
consideration of the following description in conjunction 

5S with the drawing figures, in which like reference numerals 
are carried forward. 

The invention to be described herein improves the quan- 
tization step which can be implemented as part of a data 
CODEC. Referring now to FIG, 1, there is shown a data 

eo CODEC block diagram 100 in accordance with the present 
invention. This data CODEC 100 can be applied to three- 
dimensional (3-D) systems, such as video, two-dimensional 
(2-D) systems, such as still images, as well as one- 
dimensional (1-D) systems, such as speech. 

65 Data CODEC 100 includes an encoder 110 and a decoder 
120. Briefly, an input data signal S(n) 102, having a prede- 
termined bit/sample resolution, goes through a transforma- 
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tioa at decomposition stage 112. The transformed signal x(n) sents the level from a total set of J levels per state. In 

113 then goes through a quantization stage 114 for further accordance with the present invention, the steps of trellis 

compression in accordance with the present invention. In path optimization 202, path matrix configuration 206, and 

accordance with the present invention, the quantization centroid updating 208 are adaptively reiterated until an 

stage 114 provides a centroid based quantization to generate 5 acceptable SNR, or other desired error measurement, 

non-uniform spaced quantizers. The quantized signal 115 is entropy or bit rate is achieved 210. 

then coded through coding stage 116 preferably using one of In accordance with the present invention, the trellis path 

a variety of well known coding schemes. A coded signal 118 optimization 203 is preferably achieved throug h a "least' 

is then communicated over or stored to channel 130. At the mean square" (LMS) algorithm for selecting transition s" 

receiving end, decoder 120 employs an inverse coding stage 10 from quantizer to quantizer to obtain the oath yieiamTa 

132, inverse quantization stage 133, and an inverse decom- minimum error. However, other optimization schemes carP 

position stage 134 to recreate the input data signal S(n) as also be used, such as a mini-max, to yield minimum error"* 

output data signal S'(n) 136. paths! 

The decomposition stage 112 is basically a frequency An example of a basic implementation of path optimiza- 

domain analyzer which performs data conversion through « tiofl 2 Q2 is shown in a preferred embodiment 209 where for 

one of a variety of well known methods such as wavelet, a se t of K quantizers referred to as states, each having J 

FFT (Fast Fourier Transform), DCT (Discrete Cosine \ cwc ]^ ( h e quantizers (states and levels) cover an entire 

Transform), DFT (Discrete Fourier Transform), DST ran g e of input data. The states and levels may be obtained 

(Discrete Sine Transform) KLT (Karhunen-Loewe fr om a [ argcr quantizer after splitting it into sub-sets that 

Transform), WHT(WaLsh-Hadamard Transform). The trans- 20 may initially be uniformly distributed. The quantization 

formation used here falls under what is called subband \ C y C ]s 0 f cac h state define the quantization intervals by the 

coding. In subband coding, whether 1-D, 2-D, or 3-D the mid-points, or centroids, between the levels, 

input data signal 102 is repeatedly divided through a filter [n ^ course of findin ^ begt ^ ^ ^ ^ 

^^^^^^^^j^^anm^ spondiElg to an input data sample, optimization entails 
of subband [selected coefficient .of the on^nal signal T^e 25 ^ ^ ^ Qf ^ ^ ^ ^ ^ ^ 

traiisf 0 rmedsi^al X (n)113 will thus also be referred to as les are . d tQ minimi2e a distortioil) error 

a signal of transformed coefficients. In the preferred embodi- measurement> entr y> or bit rate , 2 W The trellis is opti- 

ment of the invention, decomposition stage 112 may com- mized fof a ^aAv data set or sets, actually making it an 

pnse a wavebt such as that proposed in the next standards ^ ^ ^ ^ seyeral each of whicfa [s {n a 

for JPEG 2000 systems The wavelet helps achieve certain 30 smaller ^ timized tizer ^ ^ a 

multi-resolutional capabilities and minimizes blocking match bctwecQ ^ ^ ^ afld a data 

effects in the case of image data. sequence. If, after optimization a different data set is 

Coding stage 116 and inverse coding stage 132 can inputted, even with the same probability density function 

operate through a variety of coding schemes including but (pdfj or histogram, most of the distortion reduction could 

not limited to arithmetic, Huffman, or other well known disappear and a new optimization may be performed, thus 

coding and decoding schemes. resulting in an adaptive procedure. For a trellis quantizer of 

Channel 130 may include a wireless, wireline, acoustic, or K states, select only one of the available J levels for each 

optically linked path such as, for example, a radio frequency incoming data sample Thus, if M represents the global 

(RF) or fiber optic transmission path. The channel 130 may 4Q number of quantization steps to each state in the trellis, M/K 

likewise be a storage medium such as those now known or levels may be assigned. The first state and level for the first 

later developed. input data sample may be determined independently by 

Inverse quantization stage 133 can operate through a finding the state that yields the lowest error. Subsequently, 

variety of inverse quantization schemes including but not eacn incoming input value can only be assigned to one of 2 f 

limited to trellis coded quantization, scalar, vector, or even 45 states of all K states following a transition table, such as the 

an inverse version of the adaptive centroid based quantizer table 209 shown in FIG. 2. Therefore, it takes "f ' bits to tell 

114. Inverse decomposition stage 134 is preferably con- a decoder what transition path to follow. For example, as 

trolled by well known means such as inverse wavelet shownin 209, with f=l, from Qo, the next sample input can 

transformation or by a set of filter banks. be quantized by either Qo (or Ql) and in addition, certain 

In accordance with me present invention, the quantization 50 ba f v to tel L l ^decoder wMch level to use. The four-state 

stage 114 is a centroid-base quantizer which takes an entire ^lhs path optimization 209 or any other K state trellis can 

range of coefficients (which represent all or some of the ^° be ™ptomented in "other configuration that is basi- 

subbands) and generates optimal non-uniform allocation of ^ lts muTor 

the quantizer levels within the states. Referring now to FIG. For lne purposes of example, an LMS algorithm known as 

2, there is shown a block diagram of a four state trellis coded 55 tne Viterbi algorithm will be the minimum error algorithm 

quantizing (TCQ) stage 114 in accordance with the preferred described. The Viterbi algorithm takes a whole range of data, 

embodiment invention. Briefly, in accordance with the sayx(n)113 where n can be 0 to Nrl, and quantizes this data 

invention, a trellis path optimization 202 is performed on as P arl of a first iteration, to allow data to be allocated to the 

transformed coefficients signal x(n) 113 to generate an different levels for each state. Whatever data falls between 

output configured as a path matrix 206 upon which a 60 me quantizers will be allocated to the nearest level, 

centroid computation is performed at stage 208. The cen- The Viterbi algorithm is a "least mean square" (LMS) way 

troids are then fed back to the trellis path optimization stage of finding the minimum error for all the different paths 

202 to be used as the new adaptive centers for the quantizer between the quantizers. The Viterbi algorithm optimizes the 

levels for another iteration and generation of path matrix and path through the trellis, path ir(Q') at the i-th iteration with 

updated centroid computation. The path matrix 206 is 65 quantizer set {Q*}, following the allowable transitions. For 

formed of vector elements "n k /\ where k represents the example, while referring to the Viterbi shown in FIG. 2, the 

quantization state from a total set of K states, and j repre- sample x(n) at t-0 is quantized to Q o (0), then at t-1 the 
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transition can only go to either Q 0 (l) or Q^l). At the end of 
the LMS algorithm, the history of the path taken to yield 
minimum error is succinctly extracted and represented in the 
form of a three dimensional path matrix 206. 

From the path matrix 206, the centroids are calculated at 
stage 208 which is then used to represent the data samples 
which fell within a particular quantization state and level. 
The centroid calculation is based on an average determined 
by the following equation: 



1 



length (n kJ ) 
m = hlength (n ttJ - 



2*0M»»)X mean 



where n kj - denotes vector and if n^- is empty, then 



CD 



10 



15 



assign quantization states and levels, a non-uniform distri- 
bution of levels may be more suitable. For example, for an 
input sample range which has a Laplacian type distribution 
(i.e. sharply peaked, zero-mean distribution), a shrink factor 
can be applied to quantization steps to achieve a non- 
uniform distribution of levels. 

Referring now to FIG. 3, there is shown a graphical 
representation of the level distribution for each of the four 
quantizer states going through the first iteration of i=0. 
Graph 300 represents a possible example of the first iteration 
of quantizer states Q0, Ql, Q2, Q3 versus the four levels of 
data input ranges divided into sixteen quantization steps. 

The following table shows various ranges of input data 
and the allocation of quantizers states and levels for that 
given range (where is inclusive and is exclusive). 



(no update) 



(2) 



The newly computed and updated, centroids C k / ' are 
then fed back to the trellis path optimization stage 202 where 
they are used as the new centers for the j-th level of the k-th 
state, for the start of the next (i+l)-th iteration This is 
represented by the feedback arrow in FIG. 2. 

As an example consider a string of input data for x(n) 304 
consisting of ten samples where: 

input data= x(n) = [10.0, 10.2, 0.5, 2.18, 1.9, 13.75, 
10.40,0.1,11.2, 2.5] 



in other words, where 
x{0) = 10.0 

AD = 10.2 
*(3) = 0.5 

Jt(9) = 2.5 



25 



35 



40 



0 > 1, 


[0, 1) 




Q0 


level 0 


1 > 2, 


11. 2) 


«=a> 


Ql 


level 0 


2 > 3, 


[2, 3) 




Q2 


level 0 


14 > 15, 


[14, 15) 




Q2 


level 3 


15 > 16, 


[15, 16) 




Q3 


level 3 



Referring back to the Viterbi trellis of FIG. 2, the trellis 
takes a sample x(n ( ) and if the sample was quantized to any 
of four levels of state Q0 (or Q2) at time t-t,, then the next 
sample x(n ( -+l) at time t^+l can only be quantized to any 
of the four levels of state Q0 or Ql. Similarly, if sample x(n ; ) 
was quantized to any of four levels of state Ql (or Q3) at t=t ( -, 
then the next sample x(n t -+l) at time t=t ( +l can only be 
quantized to any of the four levels of states Q2 or Q3. 

So, for the input data x(n) given above, the data gets 
quantized through LMS stage 202 based not only on the 
value of the sampled data but also on the previous quantizer 
state. A path matrix 206 is then configured by storing the 
indexes pointing to the input data into the various matrix 
locations of n (xfar ^ leveT ^. The following table shows how the 
sampled data gets quantized and the indexes are assigned to 
the matrix locations. 



and where [0, 1, 2, 3, . . . 9] each represent an index that 
points to specific data sample value. (Note that the actual 45 
values of data samples are the transformed coefficients x(n).) 

Next, the transformed coefficients input x(n) 113 is quan- 
tized using trellis 202. In this example, trellis 202 is con- 
figured to have four states [Q0, Ql, Q2, Q3] with each state 
having four levels (therefore there are sixteen quantization 50 
steps and sixteen centroids to be computed). Though shown 
and described in terms of a four state four level trellis, one 
skilled in the art appreciates, that trellis 202 can be formed 
in a variety of configurations having two or more states, each 
state having several levels, typically, however, trellis quan- 55 
tizers utilize four states, the simplest case. 

Again, the four states of trellis 202 are quantizers Q0, Ql, 
Q2, Q3 and each state has been assigned four levels. For the 
first iteration it will be assumed that a Viterbi algorithm is 
used to obtain the least mean square error yielding path in 60 
the quantizer assignment, however other LMS algorithms 
could also be utilized. For the first iteration, a uniform 
distribution of the levels is used, however, one skilled in the 
art also appreciates that the first iteration could also be 
performed using a non-uniform distribution of the levels as 65 
well. For instance, in the case of an initial quantizer allo- 
cation that uses the distribution of the input data to best 



location of index 

x(index) = data, quantizer state #/ level and stored in matrix 

x(0) - 10.0 gets quantized by Q2 level 2 ==> *■ [0, . . . ] 

now x(l) can only be quantized with any four levels of either Q0 or Ql 
(quantizer Ql level 2 gives the lowest error) 



X(l)o 


10.2 


gets quantized by Ql level 2 ==> n^ = 


[1.. 


.] 




now x(2) can only be quantized with either Q2 or Q3 




x(2) = 


0.5 


gets quantized by Q2 level 0 ==> = 


[2... 


.] 






now x(3) can only be quantized with Ql or Q0 






x(3) = 


2.18 


gets quantized by Ql level 0 ==> n 10 = 


[3... 


• 3 






now x(4) can only be quantized with Q2 or Q3 






x(4) = 


1.9 


gets quantized by Q2 level 0 ==> = 


[2,4,. 


.] 






now x(5) can only be quantized with Q0 or Ql 






x(5) = 


13.75 


gets quantized by Ql level 3 =»> n 13 = 


[5,.. 


-3 






now x(6) can only be quantized with Q2 or Q3 






x(6> 


10.4 


gets quantized by Q2 level 2 ==> n^ » 


[0,6 . 


--] 






now x(7) can only be quantized with Q0 or Ql 






x(7) = 


0.1 


gets quantized by Q0 level 0 «=>> = 


[7.. 


] 






now x(8) can only be quantized with Q0 or Ql 






x(8) = 


11.2 


gets quantized by Q0 level 3 ==>> = 


[8,.. 


• 1 






now x(9) can only be quantized with Q0 or Ql 






x<9)- 


2.5 


gets quantized by Ql level 0 — > n 10 - 


[3,9, . 


■1 



The indexes stored in each matrix location represent the 
LMS (least mean square) of the original data (i.e. the path of 
minimum error). So, continuing through the first iteration 
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(which in this example started with a uniform distribution), 
the matrix 206 is formed of the following stored indexes: 



Boo - [7] 


n 2D - [2,4] 


iioj ■ empty 


n 21 = empty 


no 2 » empty 


Hj2 = [0,6] 


*c> - [8] 


n 23 empty 


n»- [3,9] 


n 30 = empty 


n n - empty 


n 31 = empty 


n«- [1] 


n 32 = empty 


n 13 - [5] 


n 33 = empty 



A pictorial representation of the stored indexes is shown 
in FIG. 4 to help illustrate that the path matrix 206 actually 
represents a 3-D configuration 400 of quantizer state, level, 
and index. Each input data point is represented by an index 
denoting the position in time at which the sample input point 
occurs. In the path matrix 206 of FIG. 2, each element n k j 
consists of a vector whose elements are the indices of the 
particular input data samples that were quantized to state k, 
level j. In the case where no input sample was quantized to 
state k, level j, this matrix element n kj - would be empty. 

Continuing through the first iteration of i-0, the next step 
is to calculate the centroids. As shown in equations(l), (2) 
above, the calculation of the centroid is based on an average. 
Thus, the centroid computations for the first iteration (t=i) of 
this example produce: 



10 



15 



and, 

Co, 



and 



25 



30 



35 



for n 0O -*c oo ~x{l}=QA 

-remains as previously set 
^remains as previously set 

for « 03 -*c 03 =xt8>11.2 
for n. 0 ^c. 0 -U[x(3)+x(9))-U[2. 18+2.5)-2.34 

40 

(note that prior to this iteration (at t=i-l) the centroid c% 2 

was 0.5) 
c 11 =remains as previously set 

for n 12 ^c 12 =x[l]=10.2 45 
for n 13 -»c 13 =x[5]=13.75 
c 13 =remains as previously set and 

for n M ^c M -V4[x(2)+jc(4)H*[0.5+l .9>1.2 

(note that prior to this iteration (at t=i-l) the centroid ^ 
was 2.5) 

Cjj-remains as previously set and 

for C22-H[jc(0)+x(6)}=^[10.0+10.4J=10.2 

(note that prior to this iteration (at t=i-l) the centroid 
was 10.5) 

c^sremains as previously set 

c 30 =remains as previously set 

c 31 -remains as previously set 

c 32 =remains as previously set 

c 32 =remains as previously set 

c 33 =remains as previously set 
Thus, where the previous centroids were all centered 
around 0.5, as shown in the example of FIG. 3, now a new 
centroid is available for each state and level of quantizer 



50 



55 



60 



(which is now non-uniform). The same set of data x(n) gets 
reclassified with the new centroids in the second iteration, 
and the iteration process is repeated until the error measure- 
ment for the given input signal reaches a predetermined 
desired value. FIG. 5 shows a graph 500 of an arbitrary 
example of how after one or several adaptive iterations, the 
various states and levels may change from a uniform dis- 
tribution to one that may best fit the input data. This method 
described by the invention guarantees convergence to a 
lower error at each iteration. 

Thus, taking sampled data coefficients x(n) through the 
steps of trellis quantizing with a least mean square algorithm 
to form a matrix and calculating updated centroids for each 
quantization state provides a pruning algorithm which is 
reiterated until there is suitable convergence to generate a 
desired SNR. In the case of a new subband or a new set of 
input data, the quantizer can also be trained to commence the 
first iteration using centroid values computed from a previ- 
ous data run. In this way, if similar input data is expected in 
the next input data range, the quantization can commence 
with centroid values which are much closer to being opti- 
mized and thus fewer iterations will be needed to achieve 
full optimization of a SNR. 

In the case of prior art, the quantization schemes have 
basically stopped at the Viterbi algorithm stage because it 
was assumed that the delta between the quantization levels 
was uniform. By applying applicants quantization scheme 
114 as described by the invention, the centroid calculation is 
dynamically adjusted as the distance between the quantiza- 
tion levels changes (as can be seen by comparing FIGS. 3 
and 5). Hence, while the prior art operated on a uniformly 
spaced system, the quantization scheme of the present 
invention allows for non uniformity and adaptation based on 
the input data. 

The quantization stage 114 of the present invention adap- 
tively allocates the levels of the quantization states using 
updated centroids. The quantizers are thus optimized to the 
data distribution so as to achieve improved SNR. The 
quantizer outputs 115 get coded at stage 116 and transmitted 
to channel 130. The quantizers outputs 115 are thus adap- 
tively allocated based on the incoming signal. The adaptive 
centroid based quantizer described by the invention allows 
input signals, such as an image signal, to be optimized by 
adaptively allocating the quantizations base on the input 
signal. The quantization block 114 can also be trained so that 
for certain types of signals, such as facial images during 
teleconferencing, the quantization step will commence at 
some predetermined state and level allocation to reduce 
processing time. 

The following steps summarize the adaptive centroid 
based quantization scheme in accordance with the invention: 

i) The input data range is divided into a predetermined 
number of steps. For the example described above there 
were 1 6 quantization steps for a 4-bit trellis. 

ii) The quantization steps are formed into a matrix of 
states. In the above example, steps 1, 5, 9, 13 go to state 
one, steps 2, 6, 10, 14 to state two and so on. This is the 
initial state assignment. 

iii) A shrink factor may be introduced as previously 
described when the input data is expected to have a 
predetermined distribution, such as a Laplacian distri- 
bution. 

{Q*>0; K-i}U 

iv) Run trellis with LMS algorithm, preferably a Viterbi 
algorithm. 
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v) Obtain first raw SNR value or other error measure- 
ments by computing mean square error. 



vi) Compute centroid values for the data samples, one 
centroid for each level, per state. 

vii) Obtain a refined higher SNR value by computing a 10 
new mean squared error. 

viii) Run trellis with LMS algorithm a second time using 
update centroid values from step (iv). 

viv) Recompute centroids, and obtain new values of SNR. 15 

The last value of SNR will be better than the first. The 
SNR increases in diminishing returns at each iteration cycle 
by centroid updating. 

x) Stop iterations when some predetermined SNR criteria 
is met. 20 

The advantages of the adaptive centroid based quantiza- 
tion scheme described by the invention include faster itera- 
tion process time (as compared to gradient methods) as well 
as convergence. 

One optional parameter was introduced in the above 25 
steps, a shrink factor. If the input data has a sharp distribu- 
tion like a zero-mean Laplacian, the outermost levels will 
see few data samples. Therefore, a shrink factor can be 
applied concentrating all levels into the more active center 
of the input range. The resulting SNR increases monotoni- 30 
cally at each iteration and converges towards an optimal 
SNR level. The effect of the shrink factor is to reduce the 
total number of iterations to attain the optimal SNR value. 

The system application described thus far includes a 
transformation stage, quantization stage, coding, channel, 35 
inverse coding, and inverse decomposition stage. In another 
embodiment of the invention, vectorization (converting 2D 
to ID data stream) and threshold stages will be performed 
prior to quantization 114 so that long strings of repetitive 
data can be represented by a single code and a non-zero ID 40 
data stream is obtained. FIG. 6 is a proposed implementation 
in which the data x(n) is vectorized to 1-D at stage 602 to 
produce vector coefficients 604. These vector coefficients 
604 are then compared to a threshold 606 prior quantization. 
Basically, data samples of zero and/or values close to zero 45 
will be discarded by threshold 606 to obtain a modified 
one-dimensional input data array of non-zero elements as 
inputs for the adaptive centroid based quantizer 114. 

FIG. 7 shows the 1-D data stream conversion step as part 
of a complete CODEC system 700. Once quantized there so 
may be repetitive data which is preferably coded at coding 
stage 116 for further compression. This reduces transmission 
time and computation time. Again, the advantages achieved 
through the dynamic centroid based quantization 114 will be 
achieved with the system 700 embodiment along with the 55 
additional benefit of efficient transmissions of repetitive data 
through coded signals. 

While the preferred embodiments of the invention have 
been illustrated and described, it will be clear that the 
invention is not so limited. Numerous modifications, 60 
changes, variations, substitutions and equivalents will occur 
to those skilled in the art without departing from the spirit 
and scope of the present invention as defined by the 
appended claims. 

What is claimed is: 65 

1. A method of quantizing a data signal in a digital signal 
processing system, comprising the steps of: 



receiving a series of transformed coefficients as the data 
signal; 

performing a minimum error algorithm on the trans- 
formed coefficients to determine paths of minimum 
error; 

forming a three-dimensional matrix representing the paths 

of minimum error, 
computing centroids based on the paths of minimum 

error; 

using the computed centroids as part of a next iteration 
where the computed centroids are used to represent 
new quantization states and levels; 

repeating the steps of performing through using until a 
predetermined optimization of centroids is met; and 

transmitting the centroids as the quantized signal, 

2. The method of claim 1, wherein the minimum error 
algorithm is characterized by a trellis least mean square 
(LMS) algorithm. 

3. A method of quantizing a signal, comprising the steps 
of: 

receiving an input data signal having a data range; 
dividing the input data range into a predetermined number 
of quantization steps; 

allocating the quantization steps to a number of quanti- 
zation states and levels; 

running the quantized states and levels through an error 

minimization algorithm; 
adaptively computing centroid values from the input data 

of each quantizer state and level; 
updating the quantizer states and levels based on the 

computed centroids; 
repeating the steps of dividing through updating until a 

predetermined optimization of centroids is achieved; 

and 

transmitting the updated centroids as quantizer outputs 
once the predetermined optimized centroids are 
achieved. 

4. The method of claim 3, wherein the step of running the 
quantized states and levels through a minimum error algo- 
rithm includes the steps of: 

storing an index pointing to the quantizer state and level 

for each input of sampled data; and 
forming a matrix of the stored index locations for each 

quantization state and level. 

5. The method of claim 3, wherein the minimum error 
algorithm consists of a least mean square (LMS) algorithm. 

6. The method of claim 3, wherein the predetermined 
optimization of centroids is based on a predetermined error 
threshold. 

7. The method of claim 6, wherein the step of receiving 
the input data signal includes the step of decimating the 
input data signal prior to the step of dividing. 

8. The method of claim 7, wherein the step of decimating 
comprises the step of taking every other data sample from 
the data range. 

9. The method of claim 8, further including the step of 
receiving a full string of input data to run through a final 
iteration of the steps of receiving through updating. 

10. The method of claim 3, wherein a signal-to-noise ratio 
(SNR) value or change in value is determined based on the 
computed centroids. 

11. The method of claim 10, wherein the optimization of 
centroids is based on comparing the SNR value to a prede- 
termined threshold; and 
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repeating the steps of re-running the minimum error 
algorithm, adaptively computing centroid values, 
updating the states and levels, and obtaining a SNR 
value until the SNR value or change in value reaches 
the predetermined threshold. 5 

12. The method of claim 3, where the step dividing 
comprises the step of uniformly dividing the data range. 

13. The method of claim 3, wherein the LMS algorithm is 
a Viterbi algorithm. 

14. The method of claim 3, wherein a shrink factor is 10 
applied to the quantization steps. 

15. The method of claim 14, wherein the step of dividing 
further includes the step of decimating the input data signal. 

16. A method of quantizing an input data signal in a digital 
processing system, comprising the steps of: 35 

receiving the data signal; 

running a trellis path optimization on the input data signal 
to generate a history of minimum error paths; 

forming a path matrix based on the minimum error paths; ^ 

computing a centroid based on the path matrix; 

re-running the trellis path optimization to produce non- 
uniform allocation of quantizer states and levels; and 

transmitting the computed centroids as quantizer outputs. 

17. The method of claim 16, wherein the data signal is a 25 
decimated data signal. 

18. The method of claim 16, where the trellis path 
optimization is mirror imaged. 

19. A data CODEC system for a digital communication 
system, comprising: 30 

a decomposition stage for receiving an input data signal 
and generating a signal of transformed coefficients; 

an adaptive centroid based quantizer for receiving the 
transformed coefficients and generating optimal non- 35 
uniform spaced quantizers, wherein the adaptive cen- 
troid based quantizer includes a least means square 
(LMS) stage to generate a matrix of minimum error 
paths of the quantizers and a centroid computation 
stage for computing and updating a centroid calculation 4Q 
of the matrix of minimum error path; 

a coding stage for coding the quantizers into a coded 
signal; 

a channel for transmitting the coded signal; and 

a decoder for decoding the transmitted signal. 4 * 

20. A data CODEC as described in claim 19, wherein the 
input data signal is first converted into a one dimensional 
(1-D) data input stream meeting a predetermined threshold 
in which unwanted or repetitive data is discarded. 

21. A data CODEC as described in claim 19, wherein the 50 
decoder includes an inverse of the adaptive centroid based 



12 

quantizer for converting the transmitted signal into a 
decoded signal. 

22. A data CODEC as described in claim 19, wherein 
non-uniformly spaced quantizers are generated until a pre- 
determined error measurement or bit rate is achieved. 

23. The method of claim 1, wherein the optimization of 
centroids is determined based on a predetermined signal to 
noise ratio (SNR) threshold. 

24. The method of claim 1, wherein the optimization of 
centroids is based on an entropy threshold. 

25. The method of claim 1, wherein the optimization of 
centroids is based on a bit rate threshold. 

26. The method of claim 16, wherein the computed 
centroids are transmitted to a coding stage. 

27. A data CODEC system for a digital communication 
system, comprising: 

a decomposition stage for receiving an input data signal 
and generating a signal of transformed coefficients; 

an adaptive centroid based quantizer having a matrix 
generation stage and a centroid computation stage for 
receiving the transformed coefficients and generating 
optimal non-uniform spaced quantizers; 

a coding stage for coding the quantizers into a coded 
signal; 

a channel for transmitting the coded signal; and 
a decoder for decoding the transmitted signal. 

28. A data CODEC as described in claim 27, wherein the 
input data signal is first converted into a one dimensional 
(1 -D) data input stream meeting a predetermined threshold 
in which unwanted or repetitive data is discarded. 

29. A data CODEC as described in claim 27, wherein the 
decoder includes an inverse of the adaptive centroid based 
quantizer for converting the transmitted signal into a 
decoded signal. 

30. A data CODEC as described in claim 27, wherein 
non-uniformly spaced quantizers are generated until a pre- 
determined error measurement or bit rate is achieved. 

31. A data CODEC as described in claim 27, wherein the 
channel is a wireless channel. 

32. A data CODEC as described in claim 27, wherein the 
channel is a wireline channel. 

33. A data CODEC as described in claim 27, wherein the 
channel is a optically linked path. 

34. A data CODEC as described in claim 27, wherein the 
channel is an acoustic path. 

35. A data CODEC as described in claim 27, wherein the 
channel is a fiber optic transmission path. 

36. A data CODEC as described in claim 27, wherein the 
channel is a radio frequency (RF) channel. 

• * * * * 
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